Nvidia Modulus 22.03.1 Docker images on Sunbird#
As of now, it is not possible to build the docker image on Sunbird because the Singularity version is very old i.e. from 2017 and lacks lots of improvements is last 5 years.
Here is a link if someday Singularity is updated on Sunbird.
Update: 27 June 2022
I realised that Sunbird has multiple versions of Singularity.
(modulus) module load singularity
singularity singularity/2.6.1 singularity/3.3.0 singularity/3.6.3 singularity/3.8.5
I am using this command singularity build --sandbox so that the Singularity container is writable.
[s.1915438@sl2 Modulus_source]$ singularity build --sandbox Modulus_singularity docker-archive://modulus_image_v22.03.1.tar.gz
INFO: Starting build...
Getting image source signatures
Copying blob 36ffdceb4c77 done
Copying blob 36ffdceb4c77 done
Copying blob 36ffdceb4c77 done
Copying blob 36ffdceb4c77 done
Copying blob 36ffdceb4c77 done
(there are 1000s of blobs)
:
:
:
Copying blob d34e8cff948e done
Copying config b526b5c0e3 done
Writing manifest to image destination
Storing signatures
2022/06/27 10:48:38 info unpack layer: sha256:343d3ea437912107c818a1cf9053b9fde38dcd5542ce0ad15db892fff1cc8afe
2022/06/27 10:49:11 info unpack layer: sha256:d1a5c18d4b91e50a06a05fdc40a9892e31e1e2a287af6fdb14ba8f25701a3636
2022/06/27 10:49:15 info unpack layer: sha256:3883cbe002a84148e387cdfebb3945fb0883cfebff48b9a53444e4060e64ffe7
2022/06/27 10:49:15 info unpack layer: sha256:3b8392a3a66f5998b46fbf3760fbe272cdc09e0f109d95d0ef81325bd307bde6
2022/06/27 10:49:19 warn rootless{usr/local/nvm/versions/node/v16.6.1/bin/npm} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:49:19 warn rootless{usr/local/nvm/versions/node/v16.6.1/bin/npx} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:49:30 info unpack layer: sha256:d44e977964450dfb17ae89ffe9f3d0dd6209c9540a9146d5e5a788a139690e62
2022/06/27 10:49:30 info unpack layer: sha256:25d56084240cd11f7ede5eefef8e0a22bdae633828db84fa37baa6c57b378a4f
2022/06/27 10:49:33 info unpack layer: sha256:b203f5fdcba3db1d57576b71380f04102c0cbe82ecd01a180ade85ba3cb4552f
2022/06/27 10:49:37 info unpack layer: sha256:608199dc6c998932eb00d844e6418de41d73d93b110560164f0c33d0f964273e
2022/06/27 10:49:37 info unpack layer: sha256:5697674b77d520aacf6ce74afb33672234fb280112c88dddb7c8d5f4652db870
2022/06/27 10:50:22 info unpack layer: sha256:d4ac2208ce3f6ab5fd83c0579e3787008d3d80fd7b827b15b0523495329fccb8
2022/06/27 10:50:37 info unpack layer: sha256:bc8185c3f4bd5b580c0716f016cd392eb0b64982f1e9efb7c443fdf94ac9f7c8
2022/06/27 10:50:39 info unpack layer: sha256:c33fe860d202b4ac8befe23247acc9b1642c704ed2b0e556cf43038e2e23108c
2022/06/27 10:50:39 info unpack layer: sha256:492cea41ee9b6512a3e69d590f44c62997ab606ca03c1804b3a665eaf1600dbf
2022/06/27 10:50:58 info unpack layer: sha256:131ec0c71024942babc680f114af9aa4223cb5a0c42bc4d79e8acd96523c5b80
2022/06/27 10:50:59 info unpack layer: sha256:0939ce405731d85148eca2f6a28b35d3e9551bf2a3c6fc391400e95cb9b0e4ad
2022/06/27 10:51:31 warn rootless{usr/include/rapids/libcudacxx/cuda/std/detail/libcxx/include} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:35 warn rootless{usr/lib/libarrow.so} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:35 warn rootless{usr/lib/libarrow.so.500} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:35 warn rootless{usr/lib/libarrow_cuda.so} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:35 warn rootless{usr/lib/libarrow_cuda.so.500} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:35 warn rootless{usr/lib/libarrow_dataset.so} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:35 warn rootless{usr/lib/libarrow_dataset.so.500} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:35 warn rootless{usr/lib/libarrow_python.so} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:35 warn rootless{usr/lib/libarrow_python.so.500} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:53 warn rootless{usr/lib/libparquet.so} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:53 warn rootless{usr/lib/libparquet.so.500} ignoring (usually) harmless EPERM on setxattr "user.rootlesscontainers"
2022/06/27 10:51:53 info unpack layer: sha256:f5ff786101ea8de6b154b603f7d80038f7886d360cb778a47a07714bd4a43749
2022/06/27 10:51:53 info unpack layer: sha256:7a92d06efda5cf2c14e552d28b7c5f6ea13ef2ae4391754e3754a5900ab5736e
2022/06/27 10:51:53 info unpack layer: sha256:9c94c804aa2d706223e4afe511ab88281b062ed9af0c4f176500abf2e38fb6e7
2022/06/27 10:51:53 info unpack layer: sha256:e075f9a4da5e43a88f4dcc20d91044ee16616bc14093f7751f62e1a1e96a6930
2022/06/27 10:51:54 info unpack layer: sha256:a9ba1589c2f29820330562efbb493e51e821400865129b884127d4ed322b43fd
2022/06/27 10:51:56 info unpack layer: sha256:8cb067e2883fea2a7d89001a27c36896873ae1a5b57e881fa2cfe4ae7162e472
2022/06/27 10:51:56 info unpack layer: sha256:625fdbdbbec3b0bc881e1933e06bb60c5b8d90f367213c5eab3de07f93291970
2022/06/27 10:51:57 info unpack layer: sha256:25cce3cf9ee876bc2b440e3a9ba40f6a1d5eac04c8942f53b4c7c36a999de21b
2022/06/27 10:52:03 info unpack layer: sha256:dc4916ae345838f481a224d9d368a0d811d93c7ea17ada179372cd71a508857b
2022/06/27 10:52:04 info unpack layer: sha256:7eeb6860960aa4fda3a30da74968fa3b53c174fa59e4886ec301effa822b801d
2022/06/27 10:52:04 info unpack layer: sha256:61ebd7cbb082505626cbecda9fb8fb9f2e760094bd794846e740741751e8a26e
2022/06/27 10:52:04 info unpack layer: sha256:a3d87a94cfab15d6b384432b798e1c545aed21fad584d944866e1b7ec7d3a4fb
2022/06/27 10:52:09 info unpack layer: sha256:a89cb8b1ae5eb4bb6aeedf2ef1910ff51c549b121a83099a2e8c20814197e3f2
2022/06/27 10:52:09 info unpack layer: sha256:1aaf445c45948d34e6fbfd8ff408ba46056d6fe53a6e624b29f39bafcf78ffac
2022/06/27 10:52:41 info unpack layer: sha256:372ce22e8b4f527d62dfba94109738bcd09d51ae414ab7dafae9f1ab40c4df32
2022/06/27 10:52:43 info unpack layer: sha256:2ed59146b2b7e52894ef5325e13760ea36dd85cea2a44289878cb9f133d38168
2022/06/27 10:52:44 info unpack layer: sha256:95515be115b8cfada848bd19eb9861544a6b5fbf8816117e9740a1fcc680d1a8
2022/06/27 10:52:57 info unpack layer: sha256:0a994720294beb9a4da1472c7d3173922e4a228394387dc8193071f11c806468
2022/06/27 10:52:57 info unpack layer: sha256:6f0047b1ea310fb69eaab7e6c479127cf6a9b847147ca42e351a6bdafc2fe6aa
2022/06/27 10:52:58 info unpack layer: sha256:0a69aaacfb407c8822532a72ecc4d5c691a7df236ee2553757bfd6c6aa3a9d01
2022/06/27 10:52:58 info unpack layer: sha256:3115a3f277d2fd5819eed9f7705ec3542f97abba7a9f47ca6e1e1708f64ba40f
2022/06/27 10:52:58 info unpack layer: sha256:90dd9204330dbe7d778e606567e1d3c66317b3f0d38f9b4116e15c67289375e9
2022/06/27 10:52:58 info unpack layer: sha256:5fe7104b8faa60ae56d1fd9dad64603152c648a172ab20d23c84fe09cf23a2fe
2022/06/27 10:53:00 info unpack layer: sha256:0d9bd0c78ba3e03962b2ccf763b6d1c1386248f51488594a7d1bcbfa122e52c0
INFO: Creating sandbox directory...
INFO: Build complete: Modulus_singularity
[s.1915438@sl2 Modulus_source]$ ls
Modulus Modulus_examples.tar.gz modulus_image_v22.03.1.tar.gz Modulus_singularity
Since, Singularity only allows same user level access as the logged in account we can’t overwrite the contents of /usr directory, leading to rootless warning. Also, inside the container everysingle module including Pytorch, Modulus is broken.
Will update if I find anything.